Analysis of Differential Item Functioning in Comparative Education Studies: the Case of the Civic Education Studies
نویسنده
چکیده
This study proposes and illustrates a two-stage strategy to analyze differential item functioning in comparative educational studies. At the first stage, within each country, item difficulties are estimated. At the second stage, results are combined across countries using a meta-analytic framework to investigate (a) whether the items function consistently at the country level, and (b) what country characteristics predict item difficulties. To illustrate, we analyzed data on student responses to 13 civic skills items from 28 countries, collected under the Civic Education Study of the International Association for the Evaluation of Educational Achievement (IEA), and reported initial findings. Implications of this strategy for comparative educational studies are discussed.
منابع مشابه
Differential Item Functioning (DIF) in Terms of Gender in the Reading Comprehension Subtest of a High-Stakes Test
Validation is an important enterprise especially when a test is a high stakes one. Demographic variables like gender and field of study can affect test results and interpretations. Differential Item Functioning (DIF) is a way to make sure that a test does not favor one group of test takers over the others. This study investigated DIF in terms of gender in the reading comprehension subtest (35 i...
متن کاملSelecting the Best Fit Model in Cognitive Diagnostic Assessment: Differential Item Functioning Detection in the Reading Comprehension of the PhD Nationwide Admission Test
This study was an attemptto provide detailed information of the strengths and weaknesses of test takers‟ real ability through cognitive diagnostic assessment, and to detect differential item functioning in each test item. The rationale for using CDA was that it estimates an item‟s discrimination power, whereas clas- sical test theory or item response theory depicts between rather within item mu...
متن کاملA confirmatory study of Differential Item Functioning on EFL reading comprehension
The present study aimed at investigating DIF sources on an EFL reading comprehension test. Accordingly, 2 DIF detection methods, logistic regression (LR) and item response theory (IRT), were used to flag emergent DIF of 203 (110 females & 93 males) Iranian EFL examinees’ performance on a reading comprehension test. Seven hypothetical DIF sources were examin...
متن کاملA comparative study of the country's higher education Organizing based on the spatial planning approach: Case study: Development Programs in Iran: Pre and Post Revolution
The purpose of this research is to study and compare the spatial planning of the country's higher education system with the development plans before and after the Islamic Revolution. For this purpose, the documents of development programs before and after the revolution during the years 1327 to 1396 (eleven development programs) were compared and their content from the perspective of their posi...
متن کاملInterpreting the Validity of a High-Stakes Test in Light of the Argument-Based Framework: Implications for Test Improvement
The validity of large-scale assessments may be compromised, partly due to their content inappropriateness or construct underrepresentation. Few validity studies have focused on such assessments within an argument-based framework. This study analyzed the domain description and evaluation inference of the Ph.D. Entrance Exam of ELT (PEEE) sat by Ph.D. examinees (n = 999) in 2014 in Iran....
متن کامل